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Abstract 

This paper is mainly concerned with asymptotic studies of weighted 
bootstrap for u— and v— statistics. We derive the consistency of the 
weighted bootstrap u— and v— statistics, based on i.i.d. and non i.i.d. 
observations, from some more general results which we first establish 
for sums of randomly weighted arrays of random variables. Some of 
the results in this paper significantly extend some well-known results 
on consistency of u-statistics and also consistency of sums of arrays of 
random variables. We also employ a new approach to conditioning to 
derive a conditional CLT for weighted bootstrap u— and v— statistics, 
assuming the same conditions as the classical central limit theorems 
for regular u— and v— statistics. 

Keywords: Conditional Central Limit Theorems, Laws of Large Numbers, 
Multinomial distribution, u— and v— statistics, Randomly Weighted u— and 
^-statistics, Weighted Arrays of random variables, Weighted Bootstrap 



1 Introduction 

The main purpose of this study is to investigate the validity of bootstrap u- 
and f-statistics resulting for the so-called m-out of-n scheme of bootstrap. 
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The use of this scheme results in having a randomly weighted form of the 
original u, ^-statistics. This, in turn, exhibits an explicit connection be- 
tween the original u, f-statistics and their bootstrap version. Moreover, it 
clearly identifies the two types of variations involved in a bootstrap problem 
for statistics of the form of partial sums in general and for u, f-statistics in 
particular. In this exposition, the investigation of bootstrap u, f-statistics 
includes the consistency and convergence in distribution of these bootstrap 
statistics. While the results for investigating the convergence in distribution 
for bootstrap is done only for u, f-statistics, based on i.i.d. observations, 
when m-out of-n scheme is used, the results in this paper on the consistency 
are provided in a more general way. In fact, the results on the consistency 
is restricted to neither u, f-statistics nor to i.i.d. observations or bootstrap. 
The results on consistency are dealt with for randomly weighted arrays of 
random variables. These results then are used to derive consistency for ran- 
domly weighted u-statistics as well as for bootstrap u, f-statistics based on 
i.i.d. observations and observations with absolute regularity property (cf. 
Theorems 13.11 and 13 .2} respectively). Some of the results in this work extend 
well-known results on the strong law of large numbers for arrays of random 
variables and also for ti-statistics (cf. Theorem 12.31 and Remark 12. 4p . and 
some of them shed light on the consistency of bootstrap when the original 
sample can stay finite (cf. Theorems 12.21 and 13. 2\i . 

The conditions assumed for the results in this paper are the same as the 
ones required for the classical central limit theorems (CLTs) and classical 
strong and weak laws of large numbers in the non-weighted case. In other 
words, there are no further restrictions imposed on the observations. 

The material in this paper is organized as follows. In Section [2] laws of 
large numbers are provided for randomly weighted arrays of random variables 
(observations). The presentation of these results is so that they can be used 
in establishing the consistency of bootstrap u, w-statistics which is provided 
in Section [3j Section H] is devoted to establishing conditional (given the 
weights) central limit theorems for u, f-statistics. In Section [51 remarks are 
made on the validity of the results for higher dimensional arrays of random 
variables and u, f-statistics of order greater than 2. The proofs are given in 
Section [6j 
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2 Laws of large numbers for randomly weighted 
arrays of random variables 

Consistency of bootstrap mean as randomly weighted sums was pioneered 
by Athreya [1] and followed by S. Csorgo [TT] and Arenal-Gutierrez et al. 
[3]. Since then the problem has received a great deal of attention from 
researchers. Of the contributions to the field, we specifically mention the 
two results, respectively due Arenal-Gutierrez et al. |3j, and Rosalsky and 
Sreehari [T7] , as the former influenced Theorem 13.21 and the latter motivated 
Theorem 12.11 of this exposition. 

In this paper we consider two sequences of possibly double triangular 
(with respect to m and n) arrays of random variables, {X^' m ^; 1 < i,j < n} 

and {e^' m ^; 1 < i,j < n}, n, m > 1, which are defined on the same probabil- 
ity space {£lx,e, ! 5x,e,Px,e)' Also, by (fl x , #x, Px) and (Q £) # e ,P e ) we denote 
the marginal probability spaces of the X^'^s and e^ n ' m ^s, respectively. We 
shall, often, refer to the X^'^s as the observations (data) and e( n > m )s are 
referred to as the weights. We shall investigate the large sample behavior 
of the randomly weighted sums Yli<i j< n £ iT ' n,m> 1. The obser- 

vations and the weights are so that they can be employed in studying the 
m-out of-n scheme of bootstrap for it-statistics which is to be discussed in 
Sections [3J and HI We note in passing that when the observations and the 
weights are independent, then their joint probability space can of course be 
defined as the direct product probability space (Q x x ^e, 3x <8> Je, Px x P £ ) 
of their marginals. 

In this section we present some strong and weak consistency results for 
sums of randomly weighted arrays of random variables. 

Except for Theorem l2. ll below and its application to bootstrap u-statistics 
in Theorem 13. II of the next section, the method of conditioning plays an im- 
portant role in the establishment of the results in this exposition. More 
precisely, employing hierarchical arguments, we derive our results via condi- 
tioning on the weights e( n ' m ) in some stochastic way with respect to P £ . The 
latter results, in turn, can be extended to unconditional ones in terms of the 
joint probability measure Px,e- Hence, we let P.\ £ {.) and E\ E (.), respectively 
stand for the conditional probability and conditional expected value given 
the weights e^ n,m ^ . 

The following Theorem 12.11 is a strong law of large numbers for sums of 
randomly weighted arrays of random variables. 
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Theorem 2.1. Consider the two possibly (double) triangular arrays {X^' m ^; 

1 — hj — n } an d {£-™' m ' ) ; 1 < i,j < n}, n, m > 1, of random variables which 
are defined on the same probability space. Let the sequence of positive integers 
m be such that m = m{n) — > +oo, as n — >■ +oo. Also let {c[j ; 1 < i, j < 

n} be a possibly (double) triangular array of real numbers and {a l -"' m ' ) ; 1 < 
i,j <n} be a possibly (double) triangular array of positive real numbers such 
that, for 5 > 0, 

(a) PM^le^ - c^ m) \ > 5 a$ m \ i.o.{n) ) = 0, (1) 
and, as m(n) , n — > +oo, 

/h\ \ y (n,m) I v (n,m) i . . n 

(0) a ij I < +oo a.s. - P x , 

l<i ,j<n 

( c ) 2^ C V x h < +0 ° a - s - ~ Px - 

l<i,j<n 

Then, (a), (b) and (c), as n — )■ oo, imply that 

Yli<i j< n £ ij' m ^ X^'™ 1 ^ converges a.s.-P x , £ t° the same a.s.-P x limit as that 
nf J n > m ) 

U J Z^l<i,j<n c ij ^ij 



Remark 2.1. In many cases it is natural for the numerical sequence c^"' m ^ 
to be taken to be the mean of the weights, when it exists and is finite. In 
other words, for each, 1 < i,j < n, c^" = E £ e\j' m \ n,m>l. In this case, 
in view of the first Borel-Cantelli Lemma and Chebyshev inequality, perhaps 
the first and most natural way to investigate (QP, when the weights have finite 
second moments, is to check if the following holds true: 



E E 



Var(e 



(n,m) \ 



™=1 l<«,i<n \ ij I 



< +oo. 



This would amount to a generalization of Remark 1 of 111] to the case of 
arrays of random variables. However, in this exposition, when studying boot- 
strap u- and v-statistics in Section^ we shall use Bernstien's inequality to 
investigate ^J\), as it gives sharper bounds with less computation when the 
weights are products of multinomially distributed random variables. 
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Theorem 12.11 above was motivated by, and it generalizes, Theorem 1 of 
Rosalsky and Sreehari [17J to arrays of random variables so that it can be used 
in studying the validity of the so called m-out of-n method of bootstrap u- 
statistics in Section [3j It is obvious that when dealing with regular triangular 
arrays of random variables then, on taking e( n > m ) = e^ n > and X i - n,rr ^ = X^ n \ 
Theorem 12.11 is true. It also continues to hold true for non-triangular obser- 
vations and arrays. 

The following Theorem 12.21 assumes that the observations have finite 
means and it concerns the randomly weighted sums of the form 

E(n,m) -y-(n,m) 

l<i,j<n 

of possibly (double) triangular arrays of observations {X i ^ n ' m ' ) ; 1 < i, j < n} 

and possibly (double) triangular arrays of random weights {e^'^; 1 < i,j < 
n}, n,m > 1. The key difference between Theorem 12.11 above and the next 
result is that it does not necessarily require that both n,m — > +oo. In fact 
it can be true when both, or either one of m and n, approach +oo. As a 
consequence of this, it leads to an interesting application to bootstrap u, 
v— statistics, via the m-out of-n scheme, when the number of observations n 
is fixed and only the bootstrap sample size m approaches +oo. The latter 
result is presented in Theorem 13.21 of the next section. 

Theorem 2.2. With the positive integers n, m > 1, let {X^ n,m ^; 1 < i, j < 

n} and {e\"' m ' > ; 1 < i,j < n} ; which are independent from each other, be 
possibly (double) triangular arrays of random variables such that, for 1 < 
i,j — n , Ex\xl™' m ^\ < c^' m \ where c-™'"^ > 0. Consider the following four 
statements: 

(i) n is fixed and m — > +oo ; 

(ii) m is fixed and n — > +oo, 

(Hi) n, m — > +oo such that m = m(n) is an increasing function of n, 
(*0 E H? m) \c%' m) = o(l)a.s.-P e . 

l<i,j<n 

Then, either (i) and (iv), or (ii) and (iv), or (Hi) and (iv) suffice to have 

P X\e{\ £ 4 n ' m) ^' m) | > 5 ) -+ ^ ~ P*> ( 2 ) 

l<i ,j<n 
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for any 5 > 0. 

Also, when (iv) holds true in probability-P £ to begin with, then so is the 
conclusion |||). 

Remark 2.2. Observe that when the observations are non-triangular, then 
naturally for the bounds we have c J -™' m ' ) = c^-. In this case if snp 1<i j <+oc Cij < 
+oo, then (iv) of Theorem \2.2\ can be replaced by 

E \ef 3 ' m) \=o{l)a.s.-P e . 

l<i,j<n 

Remark 2.3. Since P x \ e {\ Ei<ij<„ 4" ' m) *« I > 6 ) < 1 > h V mrtue °f 
Lemma 1.2 in S. Csdrgo and Rosalsky fTfflj . conclusion (0|) of Theorem \2.2\ 
implies that 

l<i,j<n 

The following result establishes a strong law of large numbers for sums of 
randomly weighted arrays of random variables when neither the observations 
nor the random random weights are triangular while both are assumed to be 
symmetric. This result is a generalization of the strong law of large num- 
bers for u-statistics due to Berk |5J which was proven in view of martingale 
property of w-statistics. Some ideas were borrowed from the latter paper and 
adapted accordingly. 

Theorem 2.3. Let X^ and e^, 1 < i ^ j < n, n > 1, be symmetric arrays 
of random variables which are defined on the same probability space. If, for 
all i,j, €ijXij are identically distributed and Ex,e\ 612-^12 1 < +oo ; then, as 
n — > 00, 

'■= —, TT e ijXij — > Ex,e(tl2Xi2) O.S. — Px,s- 

n(n — 1) / — ' 

Trivially, whene^ andX^ are uncorrected with E e \eij\ < +00, and Ex\X,- t j\ < 
+00, then the limit above becomes E e (ei2)Ex(Xi2) . 

Remark 2.4. Theorem \2.3\ generalizes Berk's strong law of large num- 
bers for regular u-statistics based on i.i.d. observations to randomly weighted 
arrays of random variables that may be taken to be the summands of a (ran- 
domly) weighted u- statistic based on identically distributed but not necessarily 
independent observations. 
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Theorem 12 . 31 also generalizes Theorem 2 of Etemadi |T2], on taking m = n 
in the latter. The latter result of Etemadi requires that c^jX^jS be pairwise 
independent and identically distributed random variables, with respect to 
Px,e, and that Ex,e{\tijXij \ log le^A^I} < +oo. As it can be readily seen, 
Theorem l2.3[ drops the independence as well as it requires only Ex, e \^ijXij\ < 
+oo. 

We note in passing that Theorems 12. 1} 12.21 and 12.31 assume almost no 
conditions (such as requiring certain kind of dependencies, for example) on 
the relation between the weights and the observations. 

3 Consistency of bootstrap u- & ^-statistics 

Studying the problem of consistency of the bootstrap usually consists of 
showing that the deviation of the statistic in hand and its bootstrap ver- 
sion, perhaps multiplied by some normalizing sequence, vanishes a.s. or in 
probability with resect to the joint probability of the observations and the 
bootstrap experiment. In large sample applications of the bootstrap, one use 
of such an approximation is establishing limiting distribution results for a 
bootstrap statistic in hand. As an example in our context, we refer to the 
consistency in relation (137|) below, noting that G n ^ m is a deviation between a 
it-statistic with the kernel h(Xi, X 2 ) — h(Xi) — h(X 2 ) and its weighted boot- 
strap version. The need for such consistencies has first become apparent in 
A(6) of Burke and Gombay [7j. Motivated by this, and in view of our results 
in the previous section, in this section we give some results on the problem 
of bootstrapped u— and v— statistics when the original sample is large. 

In small sample theory, the problem of consistency of bootstrap, as ex- 
plained right above Theorem 12. 2} leads to interesting results, if one can show 
that by re-sampling repeatedly from a finite sample, the thus obtained se- 
quence of bootstrap versions of a statistic in hand converges to the original 
statistic a.s. or in probability, with respect to the joint probability of the 
observations and the bootstrap experiment. The results which we developed 
in Section [2] enable us to make such conclusions for bootstrapped u- and 
v— statistics when the original sample is finite (cf. Theorems 12.21 and I3.2p . 

In this section, as well as in the next one, we shall study the so-called 
m-out of-n scheme of bootstrap which we are now to detail as follows. 
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m-out of-n scheme of bootstrap 



Draw a sample of size m > 1 with replacement from the set {1, . . . , n} of the 
indices of the original observations X\, . . . ,X n . In this scheme a bootstrap 
sub-sample of size m, denoted by X*, . . . ,X^, is drawn from the original 
sample X\, . . . , X n , n > 1, independently of the original observations. 

In this section we study the consistency of bootstrap u- and v— statistics 
via the scheme of m-out of-n. The obtained results will be seen to be appli- 
cable to i.i.d. and some stationary observations. 

A M-statistic of order 2 is defined by 

Un = ^ Y E KXi,Xj), (3) 

where, h : R 2 — > R is a measurable function which is symmetric in its 
arguments, and is called the kernel. Many of the well known statistics, such 
as sample variance, deleted jackknife variance estimator, Fisher's /^-statistic 
for estimation of cumulants, Kendal's r, Gini's mean difference, are examples 
of it-statistics. 

When investigating bootstrapped w-statistics, it is quite natural to con- 
sider f-statistics as well. A f-statistic can be viewed as an extension of a 
M-statistic of the same order, as it is defined as follows. 



V, 



l - KX^Xj). (4) 

1 1 n 

-U n + -Y,HXi,^), (5) 



n 

l<i,j<n 



n n 

i=l 



where U n is the w-statistic as in ([3]). The major difference between the u- 
statistic U n and the f-statistic V n is that the latter one includes the diagonal 
terms h(Xi,Xi), 1 < % < n, while the former one doesn't. When the kernel 
h is so that h(x, y) = i[x — y), where i is a function, then the corresponding 
u- and v-statistics coincide up to the constant (n — l)/n. Even when this is 
not the case, in view of ([5]), under some regularity conditions, U n and V n will 
asymptotically coincide. 

The reason that one should consider v-statistics when bootstrapping it- 
statistics using the scheme of m-out of-n is that, as a result of re-sampling 
with replacement, when computing the bootstrap ^-statistic, for 1 < s ^ 
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t < m, we may for example have X* = X\ and X* = X\. This event has 
probability 1/n 2 that vanishes as n increases to +00. 

A bootstrap it-statistic U* m and bootstrap f-statistic V* m based on a 
bootstrap sub-sample X*, . . . , X^ of X\, . . . , X n , resulting from the method 
of m-out of-n of bootstrap, are respectively defined as follows. 



U* 

^ n,m 



l<s^t<m fl(X*,Xt 
X^andX* are distinct 

m(m — 1) 
m(m — 1) 



and 



T/* Hl<s^Km 

n ' m ' m(m - 1) U 

T,l<L j <n wi t ) wf ) h{X u X j ) 

m{m — 1) 

where wf 1 is the number of times the index i, 1 < i < n, is chosen in the 
scheme of m-out of-n. In view of our earlier definition of this scheme of boot- 
strap it is obvious that s are independent from the original observations 
Xi, . . . ,X n . Also, it is easy to see that wf, 1 < i < n, to which we shall 
refer to as bootstrap weights or simply weights, are so that Y^=i w i = m 
and E w (Wi /m) = 1/n, 1 < i < n. That is, for each n > 1, the bootstrap 
weights have multinomial distribution with size m. In other words, 

(w^, . . . , w^) £ multinomial (m; —,...,—). 

n n 

Remark 3.1. To state our results for U* m and V* m , it is important to 
address the relation between the two bootstrap statistics. Simple calculations 
show that, rhyming with we have 

Km = Km + £ mn ;;j (4 Xi)- (7) 
1=1 ^ ' 

In this section, for a variety of observations, independent or dependent, we 
shall show that, as n, m — > +00, and at some point when only m — > +00, the 
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deviation between the bootstrap ^-statistic U* m and the associated original 
u— and v— statistics U n and V n goes to zero a.s., or in probability, with 
respect to the joint distribution of Px,w 

For the following result we consider i.i.d. observations and, as both 
m, n — > +00, we present a Marcinkiewicz type law of large numbers for 
U* m and V* m when the kernel h has less than one moment. In fact Theorem 
13.1^ below, can be viewed as a bootstrap version of Theorem 1 of Gine and 
Zinn [13]. This result is a consequence of Theorem 12 . 1 1 and reads as follows. 

Theorem 3.1. Let Xi, . . . , X n be the first n > 1 terms of an infinite sequence 
of i.i.d. random variables. 

(a) Assume that Ex\h{Xi,X2)\ 2 ^ d < +00, where d > 2. Then, as m,n —t 
+00 such that m = 0(n d ^ d ~ 2 ^ log 1 ^ n), 

™~ d+2 K,m -> a.s. - P x , w - 

(b) Assume that ExlKX^ X 2 )\ 2/d < +00 and £ x |/i(Xi,Xi)| 2 / d < +oo ; 
where d > 2. Then, as m,n — > +00 such that m = O (n d ^ d ~ 2 ^ log^^ n), 

™~ d+2 Vim -> a.s. - P x , w . 

When the first moments of the kernel h of U n and V n , which does not 
depend on the sample size n, are uniformly bounded in 1 < i,j < +00, 
then the following Theorem 13.21 is a direct consequence to Theorem 12.21 and 
Remark 12.31 

Theorem 3.2. Let Xi, . . . , X n , n > 1, which are the first n > 1 terms of an 
infinite sequence of random variables, and the kernel h be such that 

sup E x \h(Xi,Xj)\ < +00. 

l<i j'<+oo 

(a) For arbitrary 5 > 0, when the original sample size n is fixed and the 
bootstrap sample size m — > +00, then 

/ 1 n — 1 \ 

Px\ w [\U* !m - U n \ >5)^0 a.s. - P w . (8) 

Px\w[\V* >m - V n \ > 5j in probability - P w . (9) 
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Consequently, for fixed n, as m — >■ +00 



Un, m ~~ >* U n in probability — Px,w (10) 

v n, m ~> v n in probability - P x , w . (11) 

f&j For arbitrary 5 > 0, when m — >■ +00 as n — > +00 m sfic/i a way £aa£ 
ra/ (n-y/2 logn) — > +00, then both (0|) and (TJ|) hold true a.s. — P w and, con- 
sequently, 

U* m — U n —^ 0in probability — Px,w (12) 

V* m — V n — > in probability — Px,w (13) 

Part (a) of the preceding theorem is closer in spirit to what bootstrap is 
expected to do and better suites the inference one would wish to make as a 
result of re-sampling repeatedly from a finite original sample. 

The next two results are to demonstrate the application of Theorem 13.21 
for two types of observations. We first consider i.i.d. observations and in 
Corollary 13. II we establish the validity of bootstrap w-statistic U* m . Then, in 
Corollary [321 we establish the validity of the method of m-out of-n bootstrap 
for U* m when the observations posses the property of absolute regularity. 

Corollary 3.1. Let X±, . . . ,X n , which are the first n > 1 terms of an in- 
finite sequence of i.i.d. random variables, and the kernel h be such that 
Ex\h(Xi, X 2 )\ < +00 and Ex\h(Xi, Xi)\ < +00. We conclude (a) and (b) 
as follows. 

(a) For arbitrary 5 > 0, when n is fixed, as m — > +00, (TJj) and (TJ|) and their 
respective consequences [TO]) and j[Jl\) hold true. 

(b) For arbitrary 5 > 0, when n,m +00 in such a way thatrnj {ri\/2 logn) — > 
+00, then 

Px\ w {\Ul m -E x h(X 1 ,X 2 )\ > 5) -> a.s. - P w , (14) 
Px\ V) (\V* tm -E x h(X 1 ,X 2 )\ >S) ^0a.s.-P w . (15) 

Consequently, 

U* >m -)■ E x h(Xx, X 2 ) in probability - P x>w , (16) 
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V* m — > Exh(Xi,X 2 ) in probability — Px,, 



(17) 



It is noteworthy that the diagonal terms h(Xi, JQ), 1 < i < +00, have no 
influence on the limit in (1T51) and ffTTl) . 

As another example, we mention that Theorem 13.21 can be used to derive 
the validity of the bootstrap version of the v-statistic V n , using the m-out 
of-n scheme. For its use in the next result, we now consider observations with 
absolute regularity property. A strong law of large numbers for w-statistics 
based on this type of observations was established by Arcones pp. In fact 
part (b) of the following Corollary 13.21 is the bootstrap version of part (i) of 
Theorem 1 of the latter paper. 

To state our next result, we first define the mixing coefficient j3(k) as fol- 
lows. Consider a strictly stationary sequence of random variables X±, X2, ■ ■ ., 
and the two cr-fields := cr(Xx, . . . ,X S ) and := a(X s , X s+ i, . . .). Let 
{Aj}( =1 be a partition in %\ and {Bj} J - =1 be a partition in Sf^ +kl and define 



(3(k) :=- sup{^^|p x (An J B i )-Px(A)^(5 i )|;{A}[ =1 , {B 3 )U)- 
i=l j=l 

Corollary 3.2. Let Xi, . . . ,X n be the first n > 1 terms of an infinite se- 
quence of strictly stationary random variables. 

(a) If the kernel h is so that sup 1<i j <+00 Ex\h(Xi, Xj)\ < +00, then, for 
fixed n and arbitrary 5 > 0, as m — > +00, (G|) and (TJ|) and their respective 
consequences UDi) and / T77]) hold true. 

(b) If for some s > 2, sup 1<i j <+OC) E x \h(Xi, Xj)\ s < +00, and (3{n) — > ; 
as n — 7- +oo ; then, for arbitrary 5 > 0, as n,m -)■ +00 in such a way that 
mj (ny / 21ogn) — > +00, 



P 



X\w 



U* 



Ei<j^'< n E x h(Xi, Xj 



n{n — 1) 



> S I ->■ a.s. - P, 



(18) 



X\w 



Consequently, 



U* 



v* - 

n,m 



T.i<ijtj< n E xh(Xi, Xj) 



n(n — 1) 



Z)i<^j<n E x h(Xj, Xj 
n(n — 1) 



> 5) -)■ a.s. - P„. 



— > in probability — Px 



(19) 



(20) 
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v* - 

* n,m 



E 




— > in probability — P x . 



(21) 



4 Asymptotic normality of bootstrap ^-statistics 

Conditional (given the observations) central limit theorems for bootstrap it- 
statistics was investigated by Arcones and Gine [2], and Helmers [TJ]. How- 
ever, the closest result in nature to the results in this section is the paper 
by Wang and Jing |20| . where they provide Edgeworth expansions for the 
conditional (given the observations) distribution of weighted bootstrap it- 
statistics based on i.i.d. observations, assuming that the third moment of 
the kernel h exists and is finite. In contrast, on assuming that the kernel h 
has a finite second moment, we employ the method of conditioning on the 
bootstrap weights, which was first introduced by Csorgo et al. [8], to derive 
a conditional limit theorem for both bootstrap it and ^-statistics. 

Unlike the case of consistency of it-statistics, the concept of degeneracy 
is quite important in studying the asymptotic distribution of it-statistics and 
their associated u-statistics. This is a result of employing the celebrated 
method of Hoeffding reduction (decomposition) that involves the use of the 
projections of the underlying it-statistic. The number of non-zero projections 
determine the degree of degeneracy of a it-statistic (cf. for example Serfling 
j 18] or Borovskikh [6J). In our case we shall consider the it- and ^-statistics 
U n and V n defined in ([3]) and (j3J) which are non-degenerate, i.e., for all i > 1, 



where 1 < j ^ i 

The concept of degeneracy is inherited by the it-statistic U n from its 
kernel h. By this, and in a similar fashion, the concept of degeneracy can be 
extended to be used for weighted u-statistics as in Nasari |15| . Degenerate 
weighted it-statistics are to be used in our proofs. 

Let T* m be the bootstrap version of an original statistic T n , when the 
m-out of-n scheme of bootstrap is used. The validity in distribution of the 
m-out of-n method of bootstrap should ideally be investigated by directly 
showing that, for fixed sample size n and all it G R, as only m — > +oo, one 
has 



h{Xi) := ExtyiX^Xj) - ExKX^X^X,) + a.s. - F 



PxAKm < *) -> Px(T n < t). 



(22) 
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This is of the same spirit as part (a) of Theorem 13. 2\ and its Corollaries 13.11 
and l3.2l in the previous section. However, unlike the latter results, (I22p cannot 
be directly investigated as such investigation would require knowledge of the 
sampling distribution of the statistic T n for fixed n > 1, which usually is 
not the case, as in practice the sampling distribution is unknown. Therefore, 
(I2"2"j) is usually established by showing the nearness of Px tW (T* m < t) to the 
limiting distribution of the original statistic T n , as m, n — > +oo. Denoting 
the limiting distribution of properly normalized and (usually) centered T n 
by F, in the literature, as n,m +oo, the stronger conditional (given the 
sample) version 



P(b n (T* m — T n ) < t\Xi, . . . , X n ) — > F(t) a.s. — Px or in probability — Px 

(23) 



is what is shown to establish (I2"2"j) . where b n is a normalizing sequence. For 
the Student t-statistic, when the limiting distribution F is standard normal, 
Csorgo et al. [8] established the validity of m-out of-n scheme of bootstrap 
via the classical method of ( |23|) . as well as using a new method of conditioning 
on the weights, by showing that, as n, m — > +oo, 



In this section, for i.i.d. observations, we shall establish the validity, in 
distribution, of the bootstrap u- and v-statistics by proving a similar result 
to the preceding relation, i.e., via conditioning on the bootstrap weights. 

Theorem 4.1. Let X±, . . . , X n be the first n > 1 terms of an infinite sequence 
of i.i.d. random variables. Assume that U n and V n are non- degenerate, 
(a) If Exh 2 (Xi, X2) < +00, then, for all t G R, as m,n — >■ +00 in such a 
way that m = o(n 2 ), 



(b) If E x h 2 (Xi,X 2 ), E x h 2 (X 1 ,X 1 ) < +00, then, for all t e R, as m, n -)■ 



Px\w(T* m < t) — >• F(t) in probability — P w . 




<£)—>• $(t) in probability - P w (24) 



+00 in such a way that m = o(n 2 ) 




<£)—>■ $(t) in probability — P l 



(25) 
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where $ is the distribution function of a standard normal random variable, 

n 

al = n{n-l)Y,{ULi-U n ?, (26) 

i=i 

and U^-i is the jackknifed version ofU n; based on Xi, . . . , Xj+i, . . . , X n , 
defined as follows 

\ 2 ) l<h<j 2 <n 

Remark 4.1. a 2 is the jackknife estimator of a 2 := Var(h(Xi)). It was 
used by Csdrgo et al. [9] for u-type processes when studying the changepoint 
problem via Studentization. The estimator a 2 was generalized by Nasari flB/ 
for processes of u-statistics of order greater than or equal to 2. It is note- 
worthy that a 2 remains the right normalizing sequence for the weak con- 
vergence (and central limit theorem as a result) of u-statistics even when 
Eh (Xi, X2) = +00 (cf. Theorem 4 and its Corollary 1 of Nasari fTby). 

We call attention to Theorem 14 . 1 1 b eing valid when bootstrap sub-samples 
of size m = n, or smaller than n, are drawn from the original sample. 

Remark 4.2. In view of Lemma 1.2 in S. Csdrgo and Rosalsky Jfflij . we note 
that the respective unconditional versions of (24\ ) and j[2l)\) continue to hold 
true, i.e., having Px,w instead of Px\ w i n their respective statements with $ 
as their limiting distribution. 



5 Remarks on extending the results to ^-dimensional 

case 

Theorems l2.1l 12 . 2 1 and I2T31 cont inue to hold true for sums of randomly weighted 
p-dimensional arrays of randomly weighted random variables, where p is a 
positive integer such that p > 2. Theorems 13.11 [3721 and Corollaries 13.11 and 
13.21 also hold true for u— and v— statistics of order p > 2. Mutatis mutandis, 
the respective proofs of these results in the p-dimensional case remain the 
same as in the 2-dimensional case of the present paper. As for Theorem 14.11 
when dealing with -u-statistics of order p > 2, the theorem remains valid 



15 



assuming the same conditions. The only change required is to change the 
constant 2 in the denumerators of (I24p and (125 j) to p. The proof of this theo- 
rem for non-degenerate u, f-statistics of order p is in principle the same (cf. 
Appendix). 

6 Proofs 

6.1 Proof of Theorem 12.11 

The proof of this theorem can be done by modifying the proof of Theorem 1 
of [17] as follows: 

£ ij A ij — 2^ <; J 'J I 

1 <i, j <n l<i,j <ri 

, \ ^ I (n,m) (n,m) I i -t^(n,m)i 

— _ c *i I I y I 

l<i,j<n 

< s J2 4 ,m) \xi;' m) \->oa.s.-p x , 

l<i,j<n 

as n — )• oo, 5 — > 0. □ 

6.2 Proof of Theorem I2T21 

The proof of this theorem is relatively simple and we give the details only 
for the case when the convergence is a.s.— P £ . 

First consider the case when n is fixed and m — > +oo, i.e., case (i), and, 
for Si, <5 2 > 0, write 

p w { n m >! u k > m p xl£ (\ ^ k)x % k) \ > Si) > 

1 <i ,j<n 

l<i,j'<n 

< p„{n m > lUfe > m J2 \^ k) \ c( k) > S M 

l<i,j<n 

= o. 

The latter conclusion is true in view of assumption (iv), when (i) holds. 
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On exchanging m by n in the preceding argument, the proof of this the- 
orem when (ii) holds will follow. Hence the details are omitted. 

When (iii) holds, m = m(n) — > +00, as n does so, and with 81,82 > 0, 
similarly to the proof for the case (i), we write 

P w { n„>i IWMI etr {k)) x\ k ^ k)) \ > 8 t ) > 8 2 } 

l<i,j<k 

< P w {n n > lUfe > n H k r m \Ex\X% Mk)) \>8 1 8 2 } 

l<i,j<k 

<T Pin II \J k Mk))\Ak,m(k)) . r r 1 

S I 'n>l Ufc> n 2^ | C iJ > f) l"2} 

l<ij<fc 

= 0. 

Once again, the latter conclusion is true in view of assumption (iv), when 
(iii) holds. This also completes the proof of Theorem 12.21 □ 

6.3 Proof of Theorem 1231 

The proof of this theorem relies on the concept of symmetric (permutable) 
events, and is similar to the proof of the SLLN for [/-statistics due Berk [5 J . 
To prove this theorem, we first define the cr-field $ n as follows: 

3n = v(S n , S n +\, . . .). 

Note that, by definition, 5n+i C $ n , and observe that, since the e^X^s are 
identically distributed, for each n and each 1 < i ^ j < n we have 

E(e 12 X 12 \$ n ) = E(e ij Xi j \^ n ) a.s. - P x , e 



E{ - 1 EijXi^n) a.s. - P x 

nin — 1 ' 



= E(S n \$ n ) a.s. - P x , € 
= S n a.s. — Px,e- 

In view of the latter, and by Theorem 2.8.6 of [19], we now conclude that, as 
n — > oo, we have 

S n = E(e 12 X 12 \$ n ) — > E(e 12 X 12 \ n 2 < n<OQ $ n ) a.s. - P x>e . 
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Now, due to symmetry (permutability) of the tail events (cf. [IS]), it follows 
by the Hewitt-Savage 0-1 law (cf. for example Stout |19| and Theorem 2.12.4 
therein) that -E^e^-X^l H2< n <oo 5n) is a constant a,.s.-Px,e- This, in turn 
means that, as n — > +00, 

S n -)• E x ,e(e 12 X 12 ) a.s. - P x , e - 
The proof of Theorem 12.31 is now complete. □ 



6.4 Proof of Theorem I3J1 

To prove this result, by virtue of ([5]) we first observe that 



m~ d+2 U* 



E 



l<i^j<n 
n (n) 2 



(n) (n) 

m d ~ 1 {m — 1) 



^<PQ) Xj 



Z—/ m d— 1 f , 



^ m d 1 (m — 1) 



h(Xi,Xi). 



(27) 



Also, from Theorem 1 of Gine and Zinn [13J, we know that, as n — > +00, 

n, 1 Hx i ,x t )\ > , < r2/d 



n d Ei<i^<n' l (^!!^i) ~ ^ 0- Also, observe that, for 5 > 



P 



A' 



n d log 2 n 



7? 



n 2 log n 



-E 



x 



S -2/d_ 



E 



x 



h(X 1 ,X 1 



h(X 1 ,X 1 ] 

2/d 



2/d 



n log 2 n 



Now the proof of Theorem 13. II results from an application of Theorem 12. II to 
both terms on the R.H.S. of the equality (127|) . on taking 



(n,m) E ( 



In) (n) 
W: 'W. ' 
» J 

ti* 1-1 (m— 1) 



n 2 m d+2 



and 

(n,m) 



i ^ j; 

d - 2 (m-l) + n 2 m d - 3 (m-l)' 2 = 



1-1/n 



n~ d \og~ d n, i = j. 



Part (a) follows if, as n,m — > +00 such that m = 0(n d ^ d 2 ) log d ~ 2 n), for 
5 > 0, we show that 



^n(n-l)P tt ( 



n>l 



(n) (n) 



1 



m d ~ 1 (m— 1) n 2 m d 2 



> < +00. (28) 
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In view of ( I27p . part (b) will follow if, in addition to (}2"gj) . we prove that 



n>l 



W 



0)\2 



m d 1 (m 



T)-( 



1/n 



1 



nm d 2 (m 



n 2 m d 3 (m 



> 



n d log n 



< +00. 



(29) 

To establish f[2"5j) . we first note that without, loss of generality, we may assume 
that, for each 1 < i 7^ j < n and n > 1, w^wj n ^£ Binomial(m(m — 1), 1/n 2 ) . 
This, in turn, enables us to use Bernstein's inequality to estimate 

1 



n(n — 1)P,, 



(n) (n) 



rf— 1 , 



m — 1 



n 2 m d 2 



> Sn 



-d 



< n(n - 1) exp{-m(m - 1) ^ + } 



n 2 exp{ — 



n d 2(n d - 2 /m d - 2 + 5) 



}• 



The last term above is a general term of a convergent series when n, m — > +00 
such that m = 0(n d ^ d ^ 2 ^ log 53 ^ n). This completes the proof of ( )28l) and 
hence that of part (a). 

To prove ( |29|) we use Markov's inequality to estimate 



nR, 



( n )\2 



1 



it) 



< 2cTV +1 log d n( 



m d 1 (m— 1) nm d 2 (m— 1) 72 2 m d 3 (m — 1) 
1-1/n 1 



> 



n d log n 



+ 



nm d 2 (m— 1) n 2 m d 3 (m — 1) 



) 



2n d \og d n ^ 2n d ~ l \og d n 



nv 



d-l 



m 



d-2 



The last term above is a general term of a convergent series when n,m — > +00 
such that m = 0(n d ^ d ~ 2 ^ log ^2 n). Consequently, we conclude (I29p and, in 
view of having also (128 p . the proof of part (b) is complete. This also completes 
the proof of Theorem 13.11 □ 



6.5 Proof of Theorem 13^1 

On taking c^' m ^ = = E x \h(Xi, Xj)\ and noting that here sup 1<i j <+00 Cy 
< +00, the proof of ([H]) will follow from Theorem 12.21 and Remark 12.21 if we 
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show that, as m — > +00, 



(n) (n) 



E I ; \, --\=o(l)a.s.-P w . (30) 
z — ' mm — 1 m 

l<i<j<n 



In view of Remark |3TT| as m — » +00, ([9]) results from the preceding (130]) and 
the following ( 131]) : 

EI-r^TT-^h ^ 1 )- ( 31 ) 

z — ' 1 mm — 1) n z 1 

To prove f |30l . we use Bernstien's inequality along the lines of the following 
argument to write 

(n) (n) . 

w) 'w) 1 



p - £ l J T J=i iT-^l >* 

\ ' » 1 m I m — I i ) i - 

l<i^jr'<n 



m(m — 1) n 
<n(n-l)P w (\ 



(n) (n) -1 r 

W\ Wn 1 1 

I > 



m(m — 1) n 2 n(n — 1) 

r —m(m — 1) 5 2 -, , , 

<nn-l exp ^ — A }. 32 

~ V ; 1 n(n-l) 2( n(n ~ 1] +5) i 

Observe now that for the latter upper bound in (l32j) . as n is fixed, we have 

E r — m(m — 1) 5 2 
exp <^ -— . -, — tt ^ < +00. 

This completes the proof of ( 130]) . 

To establish ( 131]) . we begin with an application of Chebyshev inequality 
to write 

W) 'Y 1 A . „_o o„ / lw) ) 1x2 



\^-"m m- 1 tt 1 / m m — 1 77/ 



ram 3 n 2 m 2 mn 3 ra 3 m 
1 7 6 

nm 3 n 2 m 2 mn J 



< r 2 n 2 + + . (33) 
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The preceding relation approaches zero as m — > +00. This completes the 
proof of ( I3ip . Noting now that, in view of Lemma 1.2 in S. Csorgo and 
Rosalsky |10j . ( !T0|) and f JTT]) follow from ([8]) and fl9]), respectively, as m 4 
+00, completes the proof of part (a) of Theorem 13.21 

To prove part (b) of this theorem, it suffices to observe that the respective 
upper bounds in 0321) and (I3"3"j) are both general terms of a convergent series 
in n, when the bootstrap sample size m is so that m/(n^2 logn) — > +00. In 
other words, 



E, ,x r -m(m-l) 5 2 , 
n(n — 1) exp <^ ; -— . -, — -r \ < 



ra>l 



n(n-l) '2(^ + {) 



-00 



and 



n>l 



V n 2 1 + — — + ) < x. . 

z — ' \nm 6 n z m z mn d 



Once again, the relations (TTO]) and ( TTTj) result from Lemma 1.2 in S. Csorgo 
and Rosalsky |1U] . and this completes the proof of part (b) and that of 
Theorem O □ 



6.6 Proof of Corollary 13.11 

Part (a) is a trivial consequence to Theorem 13.21 Here we only have to argue 
part(b). 

From the strong law of large numbers for w-statistics based on i.i.d. ob- 
servations we know that, as n — > +00, U n — > Exh(Xi, X2) a.s.-Px (cf. for 
example Serffing [18]). This combined with ([8]) imply ([14]) and its conse- 
quence (TIB]) . 

By virtue of the proof of 0T5|) and its consequence ( fj~T|) follow from 
the fact that X^s are i.i.d. random variables and Ex\h(Xi, Xi)\ < +00 and 
as a result, asn4 +00, 




h{X h Xi) ->- a.s. - P x - 



i=l 

6.7 Proof of Corollary I3T21 

Once again Part (a) is a trivial consequence of Theorem 13.21 



21 



From Theorem 1 of Arcones [lj we know that, as n — > +00, U n — 
n (n-i) J2i<i^j<n E xh(X i ,X j ) -)■ a.s.-P x . This combined with (JHD imply 
( TTSj) and its consequence ( 12"U|) . 

In view of ([5]), to prove (TT9j) and its consequence (12T|) . it suffices to show 
that 

— h{Xi,Xi)^Oa.s.-P x . 

\<i<n 

To establish the latter, for 5 > 0, we use the Chebyshev inequality to write 

l<i<n l<i,j <n 

< r 2 n" 4 Efh^Xi) E^h^Xj) 

l<i,j<n 

< 5- 2 n- 2 ( sup E^h^XiMf. 

l<i<+oo 

Now the proof of Corollary 13.21 is complete. □ 
6.8 proof of Theorem 14.11 

By virtue of Remark 3 of Nasari [16] we may replace a 2 by a 2 = Ex{h) 2 < 
E x h 2 (Xi, X 2 ) < +oo. This is so since, as n — > +oo, a 2 — >■ a 2 in probability- 
Px- Therefore, to prove part (a) of this theorem, it suffices to show that 

U* — U 

P X \ W { n ' m " = <t)-> $(t) in probability - P w (34) 

Observe now that U* m — U n can be written as a weighted it-statistic as 
follows: 

(n) (n) . 
W W 1 

K,m- U n = ( 7 °^ -- ( T,)KX U X 3 ). (35) 

' y m[m — 1 n(n — 1) 

(n) («) 

In view of the preceding relation, the fact that Yli<i^j<n m(m-i) = ^ anows 
us to assume without loss of generality that E x h(Xi, X 2 ) = 0. In other 
words, the difference U* m — U n does not feel the theoretical mean of the 
original ^-statistic U n . 
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We now employ a Hoeffding type reduction for the weighted w-statistic 
U* m — U n , as in (13"5"|) . and write 

(n) (n) 

TV TV 1 ~ ~ 

Km-Un = ( 7 \^ -- ( — is)(KXi,Xj)-HXi)-kXj)) 

v m [m — 1 n(ra — 1) 

(n) (n) 

z — ' mm — 1) rain— 1) 

= : Gn,m ~l" H n rn . (36) 

The proof of part (a) follows if we show that, as ra, m — >• +oo such that 
m = o(n 2 ), then, for Si, 62 > 0, 

P w {P xlw (—=J2^== > > 5 2 } = o(l), (37) 
and for all t £ R, 

Fjcittf = = <*)->■ $(*) in probability - P w . (38) 

-VE t =i(^ - if 

We are now to prove ( 1371) . To do so we first show that as ra, m — > +00 
such that m = o(ra 2 ), for 5 > 

n (n) , 

^(l(^i)E(^r-i) 2 -i|>^)-o- <») 

v n' t=l 

First note that for each z, 1 < z < ra, 



^ ^2 „A n) ^2 



) — E wK . 

m n m n nm 

We now employ the Chebyshev inequality to bound the P w (.) statement of 
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as follows. 

n (n) , 

■Pwl h it > (— -1\>6) 

9 n 

/ \ ^ / 

" 5 2 (1 _ 1)2 E ™{1^\ 



m 2 „/A^ W 1, 2 (l-i 



m n m 

t=i 

2 n i n ) 1 s9 /'i ^2 



— -r ^ m n 



m n' J mi 



\ m n m n J mi ) 



In view of the fact that w\ , 1 < t < n, have multinomial distribution, 



after computing £7^ [(u^ ^(tOg ) 6 ] , where a,b are two integers such that 
< a, b < 2, followed by some algebra, we can bound the preceding relation 
above by: 



m 2 ( 
'1 - -) 2 I 



(jzj) 1 a-^) 4 , (^-l)(l-^) 2 , 4(n-l) 
<5 2 (1 — i) 2 I n 3 m 3 m 3 nm 3 n 3 m 

1 1 n-1 4(n-l) (l-^) 2 
_l 1 1_ _!: —L _ 2 vj_ 

m 2 nm 2 n 3 m 2 n 2 m 3 mi 



1 (Am 1 1 1 4 

5 2 I n 2 n 3 m m n 2 nm 



where a n ~ b n stands for the asymptotic equivalence of the numerical se- 
quences a n and b n . 

Clearly, as n,m — >■ 00, the preceding relation approaches zero when m = 
o(n 2 ). Now the proof of f )39|) is complete. 

In view of f l39|) . equivalently to fl37|) . we show that as n, m — > +00 so that 
m = o(n 2 ), then 

^{Px| w (m 1/2 |G n , m | > 50 > <5 2 } -> 0. (40) 

In order to establish the preceding conclusion, we first note that G n ^ m is a 
weighted w-statistic and its kernel g(Xi,Xj) := h(Xi,Xj) — h(Xi) — h(Xj) 
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possesses the property of (complete) degeneracy (cf. Nasari [TS] and Remark 
1 therein). On noting now that part (b) of Lemma 2 of Nasari |15| remains 
true even when the weights are not necessarily non-negative, we use it in the 
second line of the following argument to conclude 

P w {Px\ w (™ 1/2 \G n , m \ >6 1 ) >5 2 ] 

(n) (n) r9 

< P ( m V ( Wi ^ — ) 2 > 1(41) 

l<i^j<n 

where A is a positive constant that does not depend on n or m. Letting now 
d^ 1 = AExh £ife 1,X2 ^ , we can bound the R.H.S. of the preceding inequality by 

m[m — 1) nm{n — ±){m— 1) n z (n — l) z 
. i . . r m(m — l)(m — 2)(m — 3) m(m — l)(m — 2) 



m 2 (m — l) 2 n 3 (n — 1) m 2 {m — l) 2 n 2 (n — 1) 
m(m — 1) 2m(m — 1) 1 

^4 J 



m?{m — l) 2 n(n — 1) m(m — l)n 3 (n — 1) n 
2 1 

~ ( — I ) — > 0, as n,m — )• +oo. 

n m 

Now the proof of ( 157)) is complete. 

To derive (138|) . we first write H n ^ m as follows. 

n n „,,(")„,, (") •, / (n)\2 1 

fl„ = (J^l- i )-(4^- -r^n )} 

x m [m — 1) n[n — 1) m{m — 1) n[n — 1) 

= y(3 L-)~ h ( Xi ) + Y( {w * ' - -—l—WXi) 

^ v m-l n-l> y ' j^ K m(m-l) n{n-l)> v ; 
=: Hn ;m (l) + H rhm {2). 



Note that for H niTn (l) we have 

n (n) -, 
fln,«(l) = T,{- )HXi) 



m n 

i=l 

n (n) , 

W, 1 



+ Y(— ^ — - r )to). 

v m(m — 1) n(n — 1) 
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Since, h(Xi), h(X 2 ), . . ., is a sequence of centered i.i.d. random variables, 
from conclusion (2.13) of Corollary 2.1 of Csorgo et al. [8], on replacing the 
sample variance S n by the population variance a therein, we know that, as 
m, n — > +00 such that m = o(n 2 ), then 

P X \ W ( = - <tH $(t) in probability - P w 

vyEt=i{-^-n) 

for all t G R. By this, in view of (139]) . to complete the proof of part (a) it 
only remains to show that 

n (n) -, 

PxU™ 1/a \ E ( H n - "7 > *) = (42) 

1 j' v m(m — 1) n{n — I)' 1 

and 

P xh (m 1 / 2 |i/ n , m (2)| > 5) = o Pii ,(l), (43) 

where 5 > is an arbitrary positive constant. 

To establish relation (1421) . for 5 £2 > 0, we write 

n (n) -, 

P w {PxJm 1/2 \ £ ( ^ n - "7 Tt)^W| > *i) > $>} 

V 1 f-^ y m(m — 1) 72(72 — 1) 1 / J 

ra ( n ) 1 JT £ 

< p^VlJ - |> ! 

- -1 Z^l m ( m _x) n ( n _i)l ^ 2£ Jf |/i(X 1 ,X 2 )| ; 

< 2E x \h(X 1 ,X 2 )\m 1 / 2 n m | 1 

~~ ^m(m — l)n n(n — 1) 



2^|/i(X 1) X a )|^J_ + V^|^ 0) 



(5i^2 y/rn n 

as m, n — > +00 such that m = o(n 2 ). 

To prove (143 p . with a similar argument as the one used to prove (|42|) . we 
bound its Px"|w(-) statement by 

P im 1/2 T\ K( " ))2 — 1> ^ I 

-1 Z^l m ( m _x) n {n-iy E x \h(X x ,X 2 )y 

2E x \h(X u X 2 )\m^n ^ (w^) 2 , 1 , 

- (AiA— 7 ttJ "I 7 ttJ 

01O2 m(m — 1) n[n — 1) 

2E x \h(X 1 ,X 2 )\^ 1 | 2Vm^ ; Q 



<5i^2 vm n 
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This completes the proof of ( |43p and that of part (a) of this theorem. 

The proof of part (b) to a large extent relies on part (a) in view of the 
following relation. 



V* —V U* — II 

v n,m v n u n,m u n 



(44) 



+ — Ta^ m^ __ (45) 

2a n n\n-l)^Yr t=l ^-l) 2 

^ Yji=l (m(m-l) ~~ ^z)h{Xi,Xi) 



In part (a) it was shown that the conditional distribution of the (144)) part of 
the above equality converges to normal in probability- P w . We now show the 
hierarchical asymptotic negligibility of parts f)45p and (l4"6"j) . To do so, we first 

(n) 

replace the estimator a 2 by a 2 = Exh 2 (Xi) and Y^t=x(~ ± ~ \) 2 ^y 1/m. 

To deal with ( l4"5j) . it suffices to observe the asymptotic a.s.-Px negligibility 

° f mV 2 Ei< ¥i -<nM^,^') 

n n(n — 1) 

that results from the strong law of large numbers for w-statistics (cf. for 
example Serfling (1980)), provided that m = o(n 2 ). 

We now use a similar argument to the one used to prove (|43|) to write 

n i (n)\2 -i 

P w {Px\ w (m 1/2 \ V ( P J n - -)MX,X)| > 50 > <5 2 } 
i=i v 7 

< p/ m v 2 y|4^1l!___i_ i> ^ i 

l f J 1 m I m — 1 1 n ») — 1 I 1 



i=l 



m(m-l) n(n-l)' £x|/i(Xi, X x ) 



—7- 0, as n, m — > +oo. 

The preceding yields the asymptotic hierarchical negligibility of (T46|) . By this 
the proof of part (b) and that of Theorem I4.1l are complete. □ 
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Appendix 



The use of the Hoeffding decomposition to reduce the underlying weighted 
it-statistic of order p > 3 to weighted partial sums yields p — 1 completely 
degenerate weighted u-statistics of order p to order 2. In view of Part (b) 
of Lemma 2 of Nasari [15J, the hierarchical asymptotic negligibility of each 
one of these completely degenerate weighted it-statistics can be done by es- 
tablishing an approximation similar to ( |4"T|) . This should be followed by an 
application of Chebyshev's inequality, similarly to the argument that follows 
( HTj) . Similarly to the case p — 2, the conditional asymptotic normality for 
the weighted partial sums of i.i.d. random variables, resulting from the Ho- 
effding reduction, is concluded from Corollary 2.1 of Csorgo et al. [8j , via 
steps similar to those used when dealing with H n ^ m in Theorem 14.11 □ 
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